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We synthesize a burgeoning literature investigating why people believe and share false or highly 
misleading news online. Contrary to a common narrative whereby politics drives susceptibility to 
fake news, people are better at discerning truth from falsehood when evaluating politically 
concordant news. Instead, poor truth discernment is associated with lack of careful reasoning and 
relevant knowledge, and the use of heuristics like familiarity. Furthermore, there is a substantial 
disconnect between what people believe and what they share on social media. This dissociation is 
largely driven by inattention, more so than purposeful sharing of misinformation. Thus, 
interventions can successfully nudge social media users to focus more on accuracy. Crowdsourced 


veracity ratings can also be leveraged to improve social media ranking algorithms. 


Keywords: fake news, misinformation, social media, news media, motivated reasoning, dual 


process theory 


Toward a psychology of false and misleading online news 

Fabricated news is nothing new. For example, in 1835 The Sun newspaper in New York 
published six articles about purported life on the moon which came to be known as the “Great 
Moon Hoax”. During the 2016 U.S. Presidential Election and U.K. Brexit referendum, however, 
a different form of “fake news” (see Glossary) rose to prominence (see Box 1): false or highly 
misleading political “news” stories, primarily originating on social media [1]. Concern about 
fake news was redoubled in 2020, in the face of widespread misinformation and 
disinformation [2] on social media about the COVID-19 pandemic [3] and 2020 U.S. 
Presidential Election [4]. Misleading hyperpartisan news, as well as yellow journalism [5], 
are related forms of problematic news content that are prevalent and a likely source of political 
polarization [6]. What about human psychology — and its interaction with social media [7,8] — 
explains the failure to distinguish between accurate and inaccurate content online? Apart from 
being of theoretical interest, this question has practical consequences: Developing effective 
interventions against misinformation depends on our understanding of the underlying 
psychology. 

We will focus here primarily on online content that is presented in the form of news 
articles. However, false and misleading claims come in many forms, and there are several 
literatures that are clearly related, but outside the scope of our review (although we will draw 
some connections throughout). This includes work on conspiracy belief [9], superstition [10], 
rumors [11], bullshit receptivity [12], and misperceptions [13], among others. Furthermore, the 
paper’s focus will be on individual examples of misinformation, and not organized 
disinformation campaigns (e.g., by the Russian Internet Research Agency, or campaigns relating 


to global warming or fraud in the 2020 U. S. Presidential Election). 


Glossary 


Algorithm: Steps or calculations performed by a computer (given a set of rules) to solve a 
problem or complete a task. In the context of social media, algorithms are used to determine 
what content users see. 


Disinformation: Information that is false or inaccurate, and that was created with a deliberate 
intention to mislead people. 


Fake News: News content published on the internet that aesthetically resembles actual 
legitimate mainstream news content, but that is fabricated or extremely inaccurate. Also 
referred to as false, junk, or fabricated news. 


Hyperpartisan News: News content that is not entirely fabricated, but which covers events 
that actually occurred with a strong partisan bias. As a result, hyperpartisan news is typically 
misleading, and we therefore include it as a form of misinformation. 


Misinformation: Information that is false, inaccurate, or misleading. Unlike disinformation, 
misinformation does not necessarily need to be created deliberately to mislead. 
Misinformation is sometimes used to refer exclusively to inaccuracies that are accidental; 
however, since it is difficult to ascertain the intentions of the unknown individuals who create 
falsehoods that spread on the internet, we use misinformation as a broader umbrella term here 
(i.e., much of the content used in the studies we discuss could be classified as disinformation 
and/or hyperpartisan news and/or propaganda, etc.). 


Yellow journalism: Content that comes from newspapers, magazines, or websites that is 
poorly researched and sensationalist; created with the goal of increasing sales and, on the 
internet, clicks. Roughly equivalent to tabloid journalism. 


Box 1: Prevalence of Fake News 


Various analyses of social media and web browsing data have been used in an attempt to determine 
the prevalence of fake news, often with a focus on the 2016 U.S. Presidential Election. For example, 
using web browsing data, archives of fact-checking websites, and a survey, Allcott and Gentzkow 
[19] estimated that a particular set of news stories that are known to be false were shared on Facebook 
at least 38 million times in the three months leading up to the 2016 election (30 million of which were 
for news favoring Donald Trump). This estimate represents a lower bound since it only reflects that 
specific set of known false news. 


Other analyses have focused on fake news publishers (i.e., websites) rather than individual articles. 
Based on data from Twitter [118], Facebook [80,119]), and web browsing [91], these studies have 
concluded that content from known fake news sites represents a small proportion of most people’s 
media diets, and that the average social media user was exposed to little fake news during the 2016 
election. 


These analyses have important limitations, however, because the only available data is what people 
sharing and what they visit when they click through to visit news sites off-platform. But, of course, 
the vast majority of the time that people are exposed to news on social media, they simply read the 
post without sharing it or clicking on the link to visit the actual source website. Furthermore, so-called 
“fake news” only represents one category of misinformation (see Glossary) and misleading content 
from sources such as hyperpartisan news websites likely represents a much larger proportion of 
people’s media diets [6,120]. Thus, the actual on-platform exposure of the average user to 
misinformation remains an open question [121]. We feel it is premature to conclude that exposure 
rates are minimal, and thus that false and misleading news online is not a problem (see also [7,8]). 
This is especially true when looking beyond the 2016 election, as new misinformation threats — such 
as false claims about Covid-19 [3,49] and fraud in the 2020 U. S. Presidential Election [4] — have 
gained widespread traction through amplification by (mostly Republican) political elites. 


Accordingly, exposure to fake news (and misinformation more broadly) is not equally distributed 
across all users. In particular, political conservatives and older adults were far more likely to visit fake 
news websites or share fake news articles during the 2016 Presidential Election [19,91,118,119]. 
Studies have also found associations between political conservatism and belief in misinformation in 
the United States [20,49], Chile [122], and Germany [123], but not in Hungary [24]; and users who 
engage in less reasoning have been found to share content from lower quality news sites on Twitter 
[74]. Thus, even if it was true that the average social media user was not exposed to that much 
misinformation, exposures rates are substantially higher in subpopulations that may be particularly 
vulnerable to believing inaccurate content. Finally, misinformation that originates on social media 
sometimes transitions to much larger audiences when it gets picked up by traditional media outlets — 
either via direct repetition or debunking (which may result in inadvertent amplification). 


Why do people fall for fake news? 

When considering the factors that may influence what people believe, it is essential to 
distinguish between two fundamentally different ways to conceptualize belief in true and false 
news. One common approach is to focus on truth discernment, or the extent to which 
misinformation is believed relative to accurate content. Discernment, typically calculated as 
belief in true news minus belief in false news (akin to ‘sensitivity’ or d’ in signal detection 
theory [14]) captures the overall accuracy of one’s beliefs - and thus gives insight into failures to 
distinguish between true and false content (“falling for fake news”). 

Another approach is to focus on overall belief, or the extent to which news — regardless 
of its accuracy — is believed (calculated as the average or sum of belief in true news and belief in 
false news, akin to calculating ‘bias’ in signal detection theory [14]). Critically, factors that alter 
overall belief do not impact people’s ability to tell truth from falsehood [15]: Increasing or 
decreasing belief in true and false headlines to an equivalent extent has no effect on the overall 
accuracy of one’s beliefs (i.e., does not affect truth discernment). 

Political partisanship and ideology 

A popular narrative is that the failure to discern between true and false news is rooted in 
political motivations. For example, it has been argued that people are motivated consumers of 
(mis)information [16] — that they engage in “‘identity-protective cognition” when faced with 
politically valenced content which leads them to be overly believing of content that is consistent 
with their ideology and overly skeptical of content that is inconsistent with their ideology [17]. A 
related theory argues that people place loyalty to their political identities above the truth — and 


thus fail to discern truth from falsehood in favor of simply believing ideologically concordant 


information [18]. These accounts contend that a strong causal influence of political motivation 
on belief is thus the dominant factor explaining why people fall for fake news. 

It is clearly true that partisanship is associated with overall belief: People are more likely 
to believe news content that is concordant (versus discordant) with their political ideology [19- 
25], see Figure 1b. It is important to note, however, that the effect of political concordance is 
typically much smaller than the effect of the news’s actual veracity [20,21,26]. That is, true but 
politically discordant news is typically believed much more than false but politically concordant 
news - politics does not trump truth. Furthermore, greater overall belief in politically consistent 
news does not necessarily indicate politically motivated reasoning. Such differences could even 
arise from unbiased rational (e.g. Bayesian) inference built on prior factual beliefs that differ 
across party lines (e.g., due to exposure to different information environments) [27—33]; see Box 
2 for details. 

But what about the impact of political concordance on truth discernment? Greater overall 
belief in politically concordant news might seem to suggest that people are more inaccurate when 
assessing politically concordant news. — that is, that political concordance (and the associated 
motivations) interfere with truth discernment The data, in fact, reveal the opposite pattern: 
People are somewhat better at discerning truth from falsehood when judging politically 
concordant news compared to politically discordant news, see Figure la. 

Taken together, the evidence therefore suggests that partisanship and politically 


motivated reasoning are not the primary factors driving the inability to tell truth from falsehood. 


1.75 . 
Truth Discernment 

1.50 (Belief in True - Belief in False) 
1.25 @ Low vs High Cognitive Reflection 

+ Discordant vs Concordant Partisanship 
1.00 
0.75 © 
0.50 © © 


O S®eoece0e 
025 O gT a oo Ses 
0.09 —_—# @—_@ ¥_. __~_»®__ 


Difference in z-scored Discernment 


-0.25 
-0.50 
All R19-1 B20 B21 P21-1 P19-1 B19-2 P21-6 B19-1 P18-3 P20-1 D20-2 M21-2 R19-2 D20-1 
Obs: 15442 502 354 2281 500 800 443 252 499 937 5242 1872 715 485 560 
1.75 . 
Overall Belief + 


1.50 (Belief in True + Belief in False)/2 


Difference in z-scored Overall Belief 
oO 
a 
+ 
+ 
® 
& 
+ 
+ 


-0.25 O e@ e oe 
0.50 & © 

All R19-1 B20 B21 P21-1 P19-1 B19-2 P21-6 B19-1 P18-3 P20-1 D20-2 M21-2 R19-2 D20-1 
Obs: 15442 502 354 2281 500 800 443 252 499 937 5242 1872 715 485 560 


Figure 1. Partisan concordance and cognitive reflection have divergent relationships with belief. Reasoning (or 
lack thereof) is much more strongly related to truth discernment than political concordance, whereas political 
concordance is much more strongly related to overall belief than reasoning. Data from 14 studies [21,26,34—41] in 
which U.S. participants were asked to rate the accuracy of actual news posts from social media (headlines equally 
balanced true versus false, and Democrat-consistent versus Republican-consistent). Study names are indicated by the 
first author’s last initial and publication date, followed by a dash and study number for multi-study papers; the 
number of participants in each study is indicated under the name. Data from all 14 studies is pooled to calculate the 
“All” values. (A) Difference in truth discernment (belief in true news minus belief in false news) between 
participants who scored higher on the Cognitive Reflection Test relative to those who scored lower (median split; 
collapsing over headline political concordance) and between headlines that were politically concordant relative to 
politically discordant (collapsing over participant cognitive reflection). More reflective participants were more 
discerning than less reflective participants, and discernment was higher for politically concordant headlines than 
politically discordant headlines. Critically, the difference based on reasoning was roughly twice as large as the 
difference based on partisanship. (B) Difference in overall belief (average of belief in true news and belief in false 
news) between participants who scored higher on the Cognitive Reflection Test relative to those who scored lower 
(median split; collapsing over headline political concordance) and between headlines that were politically 
concordant relative to politically discordant (collapsing over participant cognitive reflection). More reflective 
participants had somewhat lower overall belief than less reflective participants, while overall belief was higher for 
politically concordant headlines than politically discordant headlines. 


Box 2: Challenges in identifying politically motivated reasoning. 


The observation that people are more likely to believe information that is consistent with their 
political ideology/partisanship (and less likely to believe inconsistent information) is often taken as 
evidence for politically motivated reasoning [22,124,125] . Critically, however, this pattern does not 
actually provide clear evidence of politically motivated reasoning, because partisan identity is likely 
confounded with other relevant variables [27,126]. Most notably, partisans differ in what they 
believe about the world, even when it comes so-called “factual beliefs” — or beliefs that relate to facts 
or empirical evidence [28], such as in the case of global warming [127]. This is critical because a 
large body of evidence from entirely non-political contexts shows that what people believe to be true 
about the world influences their reasoning (a phenomenon known as belief bias; [128]). And indeed, 
once prior beliefs are accounted for, the apparent impact of political concordance on processes of 
belief formation is typically greatly reduced or eliminated [28,29,129]. Thus, observing a difference 
across ideological lines is not sufficient evidence to conclude that partisan identity or political 
motivations are themselves responsible for the difference [27,126]. 


To clearly disentangle the impact of partisan identity or motivations versus prior beliefs, further 
experimental work is needed — e.g., that manipulates prior factual beliefs and/or political motivations 
[27,30]. Relatedly, understanding the origins of partisan differences in factual prior factual beliefs is 
also of the utmost importance. Exposure to different information streams is a promising candidate: 
Entirely rational (e.g. Bayesian) and truth-seeking (i.e. non-politically motivated) people who get 
their information from conservative (e.g. Fox News) versus liberal (e.g. MSNBC) news sources 
would naturally wind up with very different factual beliefs. Evaluating new information in light of 
how well it aligns with one’s priors — although often referred to as “confirmation bias” — is not, in 
fact, necessarily evidence of bias. When there is uncertainty about the reliability of information 
sources or data generating processes, it can be entirely consistent with Bayesian inference to be 
skeptical of information that is inconsistent with one’s prior factual beliefs [30,130]. In such cases, 
Bayesian agents may infer that the source or data generating process is unreliable more so than that 
their prior belief was incorrect — and doing so would not be evidence of bias per se (where bias is 
defined as deviating from some normative, e.g. Bayesian, benchmark) [131]. 


Finally, the critique described in this box also applies to inferring “motivated system 2 reasoning” 
from the observation that cognitive sophistication is sometimes (but not always or even frequently 
[132—134]) associated with polarization rather than accuracy [17]. The association between cognitive 
sophistication and polarization (e.g. in the context of climate change) disappears entirely once prior 
factual beliefs are accounted for [28]. Instead, it appears that more cognitively sophisticated 
individuals may place more weight on their prior beliefs when evaluating new evidence, rather than 
placing more weight on concordance with their political identities. Of course, people’s prior factual 
beliefs may themselves be caused by politically motivated reasoning - but they need not be, and most 
study designs cannot determine (but must assume) a causal connection. 


Reasoning 

Another perspective on the (in)ability to differentiate between truth and falsehood comes 
from the field of reasoning. Work in this vein has a particular focus on dual-process theories that 
stipulate that analytic thinking can override automatic, intuitive responses (see Box 3 for details). 
The key question this perspective asks is what the role of reflective reasoning is in the ability to 
discern fake news from truth. 

One potential answer, which follows from the above-referenced work on political 
ideology, argues that deliberative (“System 2”) reasoning is often motivated by political identity, 
and that people engage in “identity protective cognition” [16]. This account predicts that 
engaging in more deliberation should lead to more politically polarized beliefs — and, most 
importantly, to greater belief in politically concordant but false claims. Thus, more deliberation 
should be associated with worse truth discernment. 

In contrast, more “classical” reasoning accounts (i.e., ones more consistent with work on 
dual-process reasoning in other domains) portray System 2 reasoning as being responsible for 
correcting faulty intuitions (see Box 3). This perspective therefore predicts that people who 
deliberate more will simply be less likely to believe false content — and better able to discern 


between true and false content — regardless of the news’ political concordance. 
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Box 3: Dual-process models of reasoning and the consequences of deliberation 


Dual-process theories are a core component of research on the cognitive science of reasoning. These 
theories argue that human cognition can be partitioned into two fundamentally different types of 
processes that differ in terms of their characteristics [46,135,136]: Type 1 (or System 1) processing 
that is characterized primarily by automaticity such that Type | outputs (“intuitions”) come to mind 
directly as a response to the stimulus and Type 2 (or System 2) processing that is characterized by the 
deliberation that may or may not arise given a particular intuitive output (or set of outputs). 


Consider the following problem from the Cognitive Reflection Test [137]: “A bat and ball cost $1.10 
in total. The bat costs $1.00 more than the ball. How much does the ball cost?” The incorrect 
intuitive answer — 10 cents — comes to mind intuitively for most people whereas the correct answer — 
5 cents — emerges (for most) only with an additional deliberation process [138]. Performance on 
tasks such as the Cognitive Reflection Test are associated with a wide range of beliefs and behaviors 
[139], including actual social media behaviors observed on Twitter [74] (see also [110]), as well as 
conspiracy ideation [140], bullshit receptivity [12], and endorsement of a variety of epistemically 
suspect beliefs [139]. Importantly, although dual-process theories typically emphasize the importance 
of overriding incorrect intuitions via analytic thinking, this should not be taken to imply that 
intuitions are always incorrect or that analytic thinking is always accurate [136]. 


Across numerous recent studies, the evidence supports the classical reasoning account 
over the motivated System 2 reasoning account. People who are more reflective (see Box 3) are 
less likely to believe false news content — and are better at discerning between truth and 
falsehood — regardless of whether the news is consistent or inconsistent with their ideology 
[20,26,37,40]; see Figure 1. The same pattern is evident with respect to discernment between 
biased and misleading hyperpartisan news and true (mainstream) news [40] and when judging 
full news stories as opposed to just headlines [42], and using measures beyond the Cognitive 
Reflection Test (Figure 1), such as thinking disposition questionnaires [37] and the Berlin 
Numeracy Test [40]. Belief in fake news is also associated with delusionality [37], dogmatism 
[37], religious fundamentalism [37], bullshit receptivity [43], and overclaiming [43] (all factors 
associated with analytic thinking; see Box 3). Furthermore, experimentally manipulating 


participants’ level of deliberation demonstrates a causal effect whereby deliberation reduces 
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belief in false (but not true) news, regardless of ideological alignment (and has no effect on 
polarization) [26]. Research also shows that overconfidence may contribute to susceptibility to 
false information [44], perhaps because it stops people from slowing down and engaging in 
reflective reasoning [45,46]. 

How, then, are people determining news veracity? The correlation between cognitive 
reflection and disbelief in fake news is stronger in cases where the content is more obviously 
implausible (and vice versa for true news) [20]. This suggests that, in cases where people 
actually do stop and think, relevant prior knowledge is likely to be a critical factor. Indeed, 
political knowledge is positively associated truth discernment for political news content [23,41], 
as is media literacy [47] and general information literacy [48]. Similarly, basic science 
knowledge is positively associated with truth discernment for (mis)information about COVID-19 
[49]. This implies, unfortunately, that reasoning may not improve accuracy in contexts where 
prior knowledge is heavily distorted (e.g., by partisan media consumption or misinformation 
campaigns by political elites — climate change being a prime example) [28]; see Box 2. 

Thus, when it comes to the role of reasoning, it seems that people fail to discern truth 
from falsehood because they do not stop and reflect sufficiently on their prior knowledge (or 
have insufficient or inaccurate prior knowledge) — and not because their reasoning abilities are 
hijacked by political motivations. 

Heuristics 

Prior work in judgment and decision making [50] indicates that people are likely to use 

heuristics or mental shortcuts when judging news headlines. What, then, are the specific features 


of fake news that influence people’s intuitions or cause them to make mistakes when reasoning? 
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One key route to intuitive belief in news is familiarity [43]. The influence of prior 
exposure on judgments of truth — sometimes referred to as the illusory truth effect — is well 
documented [51,52]. Indeed, wartime rumors during WWII that were more familiar were more 
likely to be believed [53]. Consistent with this, a single prior exposure to a fake news headline 
increases later belief in the headline [34,54]. Remarkably, this is evident even if the headline is 
extremely implausible (see also [55]) and inconsistent with one’s political ideology [34]. Thus, 
feelings of familiarity and, possibly, processing fluency per se [56,57] (but see [58]) likely 
contributes to increased belief in false claims. 

Another important cue that may be used when evaluating news is the source. Participants 
are more likely to believe information provided by people whom they view as being credible (for 
a review, see [59]) and a large literature from political science has robustly demonstrated the 
impact of elite messaging, in particular, on public opinion [60]. For example, attributing a false 
claim to President Trump increased Trump supporters’ belief in the claim while reducing 
Democrats’ belief in the claim [61]. Furthermore, social feedback provided by social media 
platforms (e.g. “likes”) also increases belief in news content, particularly for misinformation 
[62]; a factor that is likely to covary with elite messaging (given that political elites, such as 
Presidents or people in Congress or the media, often have many social media followers). 

Finally, a salient feature of fake news headlines also seems to be that they are often 
emotionally evocative. That is, fake news is often geared towards provoking shock, fear, anger 
[8,63], or (more broadly) moral outrage [64]. This is important because people who report 
experiencing more emotion (positive or negative) are more likely to believe false (but not true) 
news; and instructing people to rely on emotion increases belief in false (but not true) headlines 


[38]. 
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Believing versus sharing fake news 

One might expect that people share news on social media because they believe it is true. 
Accordingly, the widespread sharing of false content is often taken as evidence of widespread 
false beliefs [65,66]. However, recent work has shown that social media sharing judgments are 
actually quite divergent from judgments about accuracy [21,49]. For example, participants who 
were asked about the accuracy of the headlines rated true headlines as much more accurate than 
false headlines; but when asked whether they would share the headlines, veracity had little 
impact on sharing intentions — both in the context of political headlines [21] (see Figure 2A) and 
headlines about COVID-19 [49]. As a result, sharing intentions for false headlines were much 
higher than assessments of truth (e.g., 91% higher in Figure 2A), indicating that many people 
were apparently willing to share content that they could have identified as being inaccurate. 

To shed light on this disconnect between accuracy judgments and sharing intentions, a 
recent study examined the impact of asking participants to rate the perceived accuracy of each 
headline immediately prior to deciding whether they would be willing to share it on social media 
[21]. This experiment helps distinguish between three distinct explanations for the accuracy- 
sharing dissociation. The confusion-based account posits that people genuinely (but mistakenly) 
believe that the false claims they share are probably true. Consistent with this proposal, of the 
false headlines that were shared in the baseline condition of [21], 33% were both believed and 
shared when participants were asked directly about accuracy — however, this leaves the 


remaining 67% of sharing unexplained by confusion. 
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Figure 2. Social media sharing need not imply belief and accuracy prompts improve the quality of content 
that people share. (A) Data from [21] Study 1, where N=1002 U.S. participants from Amazon Mechanical Turk 
judged political headlines. Participants were presented with a set of headlines and either asked to indicate if they 
thought the headlines were accurate (Accuracy condition) or if they would consider sharing them on social media 
(Sharing condition). While participants were much more likely to rate true headlines as accurate compared to false 
headlines in the Accuracy conditions, headline veracity had little impact on sharing intentions in the Sharing 
conditions (interaction between condition and veracity. Interaction between condition and veracity, b=-.50, 
t(18089)=-15.37, p<.001. Error bars indicate 95% confidence intervals. (B) Data from [21] Study 7, where N=5,379 
Twitter users who had recently shared links to websites that regularly produce misleading and hyperpartisan content 
were sent an unsolicited message asking them to rate the accuracy of a single non-political headline. The news sites 
to which users retweeted links were in the 24 hours after receiving the message were compared to the links 
retweeted by participants who had not yet received the message (and date of message delivery was randomized to 
allow causal inference). The x-axis indicates the trust score given to each outlet by 8 professional fact-checkers. The 
y-axis indicates the fraction of rated links to each outlet in the 24 hours after the intervention minus the fraction of 
links to each outlet among not-yet-treated users. The size of each dot is proportional to the number of pre-treatment 
posts with links to that outlet. Domains with more than 500 pre-treatment posts are labeled. As can be seen, the 
message significantly improved the quality of new sources shared, with the change in relative tweet frequency being 
strongly related to fact-checker ratings (domains weighted by number of pre-treatment posts; 7(52)=0.74, p<.001). 
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The preference-based account is rooted in the idea that people place their preference for 
political identity (or related motives like virtue signaling [67]) above the truth, and thus share 
politically-consistent false content on social media despite recognizing that it is probably not be 
true. This purposeful sharing could be motivated, for example, by an effort to further one’s 
political agenda [18], to sow chaos [68], or to share news that would be interesting if it turned 
out to be true [69]. Of the false headlines that were shared in the baseline condition of [21], 16% 
of the headlines were shared despite being identifiable as inaccurate. Thus, although purposeful 
sharing occurs, it is unlikely to explain the bulk of false or misleading content that is shared 
online. 

Finally — and most consistent with the above focus on the lack of reflective thinking 
being a source of misjudgments — the inattention-based account argues that people have a strong 
preference to only share accurate content but that the social media context distracts them from 
this preference. Consistent with this, asking participants to rate the accuracy of each headline 
before deciding whether to share it decreased sharing of false headlines by 51% relative to the 
baseline condition [21] — suggesting that inattention to accuracy was responsible for roughly half 
of the misinformation sharing in the experiment. 

Work on social media behavior often emphasizes the importance of the “attention 
economy” where factors relating to “engagement” (likes, shares, comments, clicks, etc.) are 
selected for in social media environments [8,64,70—72]. For this reason, it is perhaps 
unsurprising that sharing of low-quality news content on Facebook is associated with ideological 
extremity [73] and that ideological concordance is a much strong predictor of sharing than it is of 
belief [21]. In a similar vein, analytic thinking is not only associated with more truth 


discernment, as described above, but is also associated with more discerning sharing intentions 
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in survey experiments (both in terms of false [40,49] and hyperpartisan content [40]) and with 
the actual sharing of more reliable news outlets on Twitter [74]. Social media also provides an 
avenue for people who feel socially and politically marginalized — i.e., those with a “need for 
chaos” — to share hostile political rumors [68]. One striking possibility is that the social media 
context itself distracts people from prioritizing the truth when they decide what to share — and, in 
some cases, may actively promote anti-social behavior [75] and hamper the exercise of analytic 
and critical thinking. Social media may be both a cause and a consequence of increased political 


engagement, both good and bad [76]. 


What can be done? Interventions to fight fake news 
We now turn to the implications of these findings for interventions intended to decrease 


the spread and impact of online misinformation. 


Current approaches for fighting misinformation 

As social media companies are, first and foremost, technology companies, a common 
approach is the automated detection of problematic news via machine learning, natural language 
processing, and network analysis [77—79]. Content classified as problematic is then down-ranked 
by the ranking algorithm so that users are less likely to see it. However, creating an effective 
misinformation classifier faces two fundamental challenges. First, truth is not a black-and-white, 
clearly defined property: Even professional fact-checkers often disagree on how exactly to 
classify content [80,81]. Thus, is it difficult to decide what content and features should be 
included in training sets, and artificial intelligence approaches run the risk of false positives and, 


therefore, unjustified censorship [82]. Second, there is the problem of non-stationarity: 
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misinformation content tends to evolve rapidly, and so the features which are effective at 
identifying misinformation today may not be effective tomorrow. Consider, for example, the rise 
of COVID-19 misinformation in 2020 — classifiers trained to detect largely political content were 
not equipped to be effective for novel false and misleading claims. 

The other most commonly used approach involves attaching warnings to content that 
professional fact-checkers have found to be false (for reviews, see [83,84]). A great deal of 
evidence indicates that corrections and warnings do successfully reduce misperceptions [41,84— 
86] and sharing [34,36,87]. Despite some early evidence the corrections checking could backfire 
and increase belief in false content [88], recent work has shown these backfire effects to be 
extremely uncommon and not a cause for serious concern [89,90]. 

There are, however, other reasons to be skeptical about the sufficiency of professional 
fact-checking. Most importantly, fact-checking is simply not scalable — it often requires serious 
time and effort to investigate whether a particular claim is false or misleading. Thus, many (if not 
most) false claims never get fact-checked. Even for those claims that do eventually get flagged, 
the process is often slow, such that warnings are absent during the claim’s period of peak viral 
spreading. Furthermore, warnings are typically only attached to blatantly false news, and not 
extremely misleading or biased coverage of events that actually occurred. In addition to 
straightforwardly undermining the reach of fact-checks, this sparse application of warnings could 
lead to an “implied truth” effect where users may assume that (false or misleading) headlines 
without warnings have actually been verified [36]. Fact-checks often also fail to reach their 
intended audience [91], and may fade over time [92], provide incomplete protection against 
familiarity effects [34], and cause corrected users to subsequently share more low quality and 


partisan content [93]. 
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Another potential approach that is commonly referenced is emphasizing the publishers of 
news articles, seeking to leverage the reliance on source cues described above. This, in theory, 
could be effective because people (at least in the U.S.) are actually fairly good at distinguishing 
between low and high quality publishers [94]. However, experimental evidence on emphasizing 
news publishers is not very encouraging: Numerous studies find that making source information 
more salient (or removing it entirely) has little impact on whether people judge headlines to be 


accurate or inaccurate [39,43,95—98] (although see [99,100]). 


New approaches to fighting misinformation 

One potentially promising alternative class of interventions involve a more proactive 
“inoculation” or “prebunking” against misinformation [8,101]. In one example, the “Bad News 
Game” uses a 10-20 minute interactive tutorial to teach people how to identify fake news in an 
engaging way [102]. An important limitation of such approaches is that they are “opt in” — that 
is, people have to actively choose to engage with the inoculation technique (often for a fairly 
substantial amount of time — at least in terms of the internet attention span; [103]). This is 
particularly problematic given that those most in need of “inoculation” against misinformation 
(e.g., people who are low on cognitive reflection) may be the least likely to seek it out. Lighter- 
touch forms of inoculation that simply present people with information that helps them identify 
misinformation (e.g., in the context of climate change: [104]) may be more scalable. For 
example, presenting a simple list of 12 digital media literacy tips improved people’s capacity to 
discern between true and false news in the United States and India [105]. 

Both fact-checking and inoculation approaches are fundamentally directed toward 


improving people’s underlying knowledge or skills. However, as noted above, recent evidence 
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indicates that misinformation may spread on social media not only because people are confused 
or lack the competency to recognize fake news, but also (or even mostly) because people fail to 
consider accuracy at all when they make choices about what to share online [21,49]. Also, as 
mentioned, people who are more intuitive tend to be worse at distinguishing between true and 
false news content, both in terms of belief (see Figure 1A) and sharing [40,74]. This work 
suggests that interventions aimed at getting people to slow down and reflect about the accuracy 
of what they see on social media may be effective in slowing the spread of misinformation. 

Indeed, recent research shows that a simple accuracy prompt — specifically, having 
participants rate the accuracy of a single politically neutral headline (ostensibly as part of a 
pretest) prior to making judgments about social media sharing — improves the extent to which 
people discern between true and false news content when deciding what to share online in survey 
experiments [21,49]. This approach has also been successfully deployed in a large-scale field 
experiment on Twitter, in which messages asking users to rate the accuracy of a random headline 
were sent to thousands of accounts who recently shared links to misinformation sites [21]. This 
subtle prompt significantly increased the quality of the content they subsequently shared; see 
Figure 2B. Furthermore, survey experiments have shown that asking participants to explain how 
they know if a headline is true of false before sharing it increases sharing discernment [106], and 
having participants rate accuracy at the time of encoding protects against familiarity effects 
[107]. Relatedly, metacognitive prompts — probing questions that have people reflect — increases 
resistance to inaccurate information [108]. 

A major advantage of such accuracy prompts is that they are readily scalable. There are 
many ways that social media companies, or other interested parties such as governments or civil 


society organizations, could shift people’s attention to accuracy (e.g., through ads, or by asking 
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about the accuracy of content that is shared, or via public service announcements, etc.). In 
addition to scalability, accuracy prompts also have the normative advantage of not relying on a 
centralized arbiter to determine truth versus falsehood. Instead, they leverage users’ own (often 
latent) ability to make such determinations themselves, preserving user autonomy. 

Finally, platforms could also harness the power of human reasoning and the “wisdom of 
crowds” to improve the performance of machine-learning approaches. While professional fact- 
checking is not easily scalable, it is much more tractable for platforms to have large numbers of 
non-experts rate news content. Despite potential concerns about political bias or lack of 
knowledge, recent work has found high agreement between layperson crowds and fact-checkers 
when evaluating the trustworthiness of news publishers: the average Democrat, Republican, and 
fact-checker all gave fake news and hyperpartisan sites very low trust ratings [94]; see Figure 
3A. This remained true even when layperson raters were told that their responses would 
influence social media ranking algorithms [109]. These studies also revealed a weakness of 
publisher-based crowd ratings, however: Familiarity with a publisher was necessary (although 
not sufficient) for trust, meaning that new or niche publishers are unfairly punished by such a 
rating scheme. One solution to this problem is to have laypeople rate the accuracy of individual 
articles or headlines (rather than publishers), and then aggregate these item-level ratings to create 
average scores for each publisher; see Figure 3B. Furthermore, the layperson ratings of the 
articles themselves are also useful. Analyzing a set of headlines flagged for fact-checking by an 
internal Facebook algorithm found that the average layperson accuracy rating was as correlated 
with professional fact-checkers as the fact-checkers were correlated with each other [80]. Thus, 
using crowdsourcing to add a “human in the loop” element to misinformation detection 


algorithms is promising. 
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These observations about the utility of layperson ratings have a strong synergy with the 


aforementioned idea of prompts that shift users’ attention to accuracy: Periodically asking social 


media users to rate the accuracy of random headlines both (1) shifts attention to accuracy and 


thus induces the users to be more discerning in their subsequent sharing, and (ii) generates useful 


ratings to help inform ranking algorithms. 


Outstanding questions 


What are the impacts of exposure to misinformation? How does exposure affect belief in 
the specific claims made in the misinformation, more general attitudes (e.g. support for 
political candidates or policies), and relevant behaviors (e.g. vote choice)? Do these 
effects differ for misinformation versus reliable news? How much misinformation needs 
to be encountered to shift attitudes and beliefs? 

Does the design of social media platforms actively promote the spread of misinformation? 
For example, by inducing distraction and incentivizing or directing attention to factors 
other than veracity? 

How do times of crisis (e.g., the COVID-19 pandemic) affect susceptibility to 
misinformation and the dynamics of social media behavior? 

To what extent do findings about misinformation and social media from the United States 
and other Western countries generalize to other cultures, and other social contexts (e.g., 
messaging apps like WhatsApp)? 

What are the similarities and differences between the psychology of online 
misinformation relative to related constellations of beliefs, such as in conspiracy ideation, 
political misperceptions, rumors, and bullshit? And how does the psychology of online 
misinformation compare to misinformation distributed by traditional media such as 
television and talk radio, or by political elites? 

How will findings about current forms of misinformation generalize in the face of the 
continually evolving nature of online content? 

Will social media corporations be willing to invest in, and implement, major changes to 
fight misinformation, given that their business models are premised on maximizing 
engagement? How can advocates and policy makers most effectively incentivize them to 
do so? 

How can academics and social media platforms collaborate to study misinformation, 
given the platforms near total control of relevant data, and widespread concerns about 
privacy? 
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Figure 3. The wisdom of crowds can help illuminate information quality. (A) Data from [94] Study 2 in which 
N=970 U.S. participants from Lucid indicated their level of trust in 60 news publishers. Average trust ratings for 
each source among Democrats (x axis) and Republicans (y axis) are shown. Although some partisan differences are 
evident (e.g. Republicans trust Fox News more than any other publisher), all hyperpartisan and fake news sites 
receive low average trust ratings from members of both parties. Thus, when creating a politically balanced lay- 
person rating by averaging trust from Democrats and Republicans, every mainstream outlet scores higher than every 
fake news or hyperpartisan outlet; and the layperson ratings correlated with ratings of professional fact-checkers at 
r(58)=0.90, p<.001. (B) Data from [39] Study 4 in which N=1,008 U.S. participants from MTurk provided accuracy 
ratings for the headlines of the 10 most-popular articles from a range of fake news, hyperpartisan, and mainstream 
accounts. Shown is a layperson outlet quality score, constructed by averaging the accuracy ratings for the 10 
headlines from each outlet, on the y-axis, compared with the rating assigned to each outlet by NewsGuard, a 
company that hires professional journalists to conduct detailed investigations of the quality of news outlets, on the x- 
axis. The layperson ratings are strongly correlated with the professional journalist ratings, 7(44)=.79, p<.001. 
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Concluding Remarks 

The spread of misinformation online presents both a scientific puzzle and a practical 
challenge. The research we have synthesized here shows that the common narrative whereby 
failing to differentiate false or misleading news from truth is a symptom of political polarization 
is not an appropriate characterization. Although people do preferentially believe news that aligns 
with their politics, this occurs as much or more for true headlines compared to false headlines — 
and thus people are actually more accurate, not less, when judging headlines that are politically 
concordant. Rather than being bamboozled by partisanship, people often fail to tell truth from 
fiction because they fail to stop and reflect about the accuracy of what they see on social media. 
Accordingly, simple prompts to think about accuracy increase the quality of content that people 
share on social media. Approaches of this nature, including simple digital literacy interventions, 
are not hindered by the same issues of scalability related to strict fact-checking approaches — and, 
in fact, can be combined with crowd-sourced fact-checking to maximize efficiency. Human 
reasoning, when applied appropriately, can be a powerful salve against the lure of 
misinformation. Nonetheless, there remain several important questions that remain unanswered 
(see Outstanding Questions). 

There is also much to be gained for psychology and cognitive science per se from 
investigating online misinformation. Fake news and other forms of online misinformation 
represent a powerful (and ecologically valid) testing ground for evaluating theories from 
cognitive, social, and political psychology. More so than many other domains, when studying 
fake news and misinformation it is often possible to combine traditional lab experiments with 


large-scale social media data [74,110] — or even to conduct actual field experiments on-platform 
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[21,111,112]. Furthermore, these topics also motivate theory development by highlighting a new 
class of problems in need of further explanation: Only a small fraction of online content draws 
sufficient attention and interest to be shared on social media. Understanding the psychology that 
undergirds the dynamics of social media sharing is an important emerging subfield in 
psychology [21,70,113] (in addition to other areas such as computer science [79], political 
science [114], communication [115], and public health [116], among others [117]), driven in 
large part by concerns around misinformation. Tackling these questions will give psychologists 


the opportunity to demonstrate the power and real-world impact of psychological theory. 
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